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I.  INTRODUCTION 


The  study  of  specific  time-optiinal  systems  has  been  continuing  in  the  devdopmmt  of 
modern  control  theory.  To  solve  an  optimization  problem,  we  must  first  define  a  goal  or  a 
cost  fimction  (poformance  measure)  for  the  process  we  are  trying  to  optimize.  With  a 
knowledge  of  the  cost  fimction,  and  the  system  states  and  parameters,  we  can  determine  the 
control  which  minimizes  (or  maximizes)  the  cost  function.  For  some  systems  a  criterion  of 
minimum  response  time  may  not  be  the  most  suitable  measure  of  system  performance. 

In  this  thesis,  a  minimum-time  control  for  a  linear,  time  invariant  third-order  regulator 
with  three  distinct,  nonpositive,  real  eigenvalues  is  developed.  The  time-optimal  control,  as 
a  fimction  of  the  states,  must  transfer  the  syston  fiom  any  arbitrary  initial  condition  to  a  target 
set  (origin  of  the  state  space)  as  quickly  as  possible. 
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II.  MINIMUM-TIME  CONTROL 


The  goal  in  a  miniinuni-tinie  proUem  is  to  tnmsfer  the  state  of  the  sy^em  to  a  target 
set  as  quickly  as  possible.  We  assume  that  the  target  set  is  the  oti^  of  the  state  space.  For 
this  reason  we  call  this  problem  the  linear  tin^-c^timal  regulator  problem.  [Rdf.  1] 

A.  PROBLEM  STATEMENT 
Consider  the  dynamical  system 

(2  1) 

where  the  n-vector  x(i)  is  the  state,  tlK  system  matrix  A  and  the  gain  matrix  B  are  n  x  n  and 
n  X  m  constant  matrices,  respectively.  The  m-vector  «(t)  is  the  control. 

We  assume  that  die  syston  (2. 1)  is  completely  controUable  and  that  the  components  of«(r) 
are  bounded  in  magnitude  by  the  relation 

(2.2) 

Given  that  at  the  initial  time  -  f ,  the  initial  state  of  the  system  is 

*(•)  -  L  (2.3) 

we  are  asked  to  find  the  control  u  *(0  that  transfers  the  system  fi-om  I  to  the  origin  •  in 
minimum  time,  pief  1  ] 

If  the  output /(<)  ofthe  system  (2  .1)  is  related  to  the  state  x(<)  and  the  control  ■(<)  by 
the  relation 

/(O  -  Cx{O*Dm{0  (2  4) 
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then  a  control  that  drives  the  states  to  the  cmgin  can  be  extended  in  sich  a  way  as  to  drive  the 
output  to  zero  and  hold  it  at  zero  thoreaiter  [Ref  1].  Ifl*  denc^  the  minimum  time  required 
to  force  the  states  to  the  origin,  then  at  r  -  /  *,  we  have 

-  •  (2.5) 

yifi  -  • 

where  the  control  is  set 

«(<)-§  V  #>  r  (2.6) 

B.  NECESSARY  CONDITIONS  FOR  THE  TIME-OPTIMAL  CONTROL 

1.  Performance  Measure 

In  order  to  evaluate  the  performance  of  a  system  quantitatively,  we  must  select 
a  performance  measure.  An  optimal  control  is  defined  as  one  that  minimizes  (or  maximizes) 
the  performance  measure.  Mathematically,  the  performance  measure  to  be  minimized  for  the 
minimum-time  problems  is  defined  as 

^  (2.7) 

2.  Pontryagin's  Minimum  Principle 

The  Hamiltonian  function  for  the  problem  is 

-  1  *p  (2  8) 

where  pW  is  the  costate  vector.  Let  us  assume  that  a  time-optimal  control  exists  and 
transfers  the  initial  state  (2.3)  to  the  origin  Q  in  minimum  time  t*.  If  *"(<)  denotes  the 
optimal  state  trajectory  of  the  system  (2.1)  corresponding  to  «*(<),  originating  at  \  at 
•  0  and  hitting  the  origin  in  minimum  time,  then  x  *(l)  and  p  need  to  satisfy  the 
canonical  equations  given  by 


3 


*•(4 -Ms; 


>r'V» 


or  equivalently 


(2.10) 


or  equivalently 


a*-(0 


>•(0  -  -.<*>•«) 


(2.11) 


(2.12) 


with  the  boundary  conditions 


*•(•)- 5 


(2.13) 


The  necessary  condition  for  all  admissible  controls  «(l)  V  f  6  [t»l  *]  is 


1  *p  •*'(<)i4x  •(<)  •(<)  i  1  •«)  *P 


(2.14) 


In  other  words  a  necessary  condition  for  ■  *(<)  to  mininuze  the  performance  measure  /  is 


<  a[x\ihp\0,»(0.n  v  r  e  {•,/!  (2  15) 


Equation  (2. 14)  yields  the  relation 


«-(0  -  -$ign{B^p*m 


(2.16) 


4 


Equation  (2. 1 S),  which  indicates  that  an  optimal  control  must  minimize  the  Hamihonian,  is 
called  Pontryt^n's  minimum  principle  [Ref.  2].  Let  us  now  state  some  important  theorems 
concerning  the  time-optimal  control. 

a.  ControUability 

Controllability  is  very  important,  because  we  consider  problems  in  which  the 
goal  is  to  transfer  a  system  from  an  arbitrary  initial  state  to  the  origin  while  minimizing  the 
performance  measure.  Thus  controllability  of  the  system  is  a  necessary  condition  for  the 
existence  of  a  solution. 

A  linear,  time-invariant  system  is  controllable  if  and  only  if  the  n  x  mn  matrix 

Q  -  (2  17) 

has  rank  n  (order  of  the  system).  If  there  is  only  one  control  input  (m  =  1),  a  necessary  and 
sufficient  condition  n  x  n  matrix  Q  to  be  nonsingular. 

b.  Observability 

A  linear,  time-invariant  system  is  observable  if  and  only  if  the  n  x  qn  matrix 

R  -  [c  '■|i4  *'c 

has  rank  n.  If  there  is  only  one  output  (q  =  1),  a  necessary  and  sufficient  condition  for 
observability  is  that  R  to  be  nonsingular. 

c.  Existence 

If  all  of  the  eigenvalues  of  the  system  matrix  A  have  nonpositive  real  parts, 
then  an  optimal  control  exists  and  it  is  bang  bang. 
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d.  Uniqueness 

If  an  extremal  contrd  exists,  tlmi  it  is  unique.  A  control  which  satisfies  file 
necessary  conditions  in  equations  (2.9)  through  (2. IS)  is  called  an  extremal  control. 

e.  Number  of  Smtchings 

If  the  eigenvalues  of  the  system  matrix  i4  are  all  real  and  a  unique  time- 
optimal  control  exists,  then  the  control  can  switch  at  most  n-1  times. 
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Ill .  TIME-OPTIMAL  CONTROL  OF  A  SECOND-ORDER 


PLANT  WITH  TWO  TIME  CONSTANTS 

A.  TIME-OPTIMAL  SYSTEMS 

The  problems  we  consider  in  this  and  the  next  chapter  will  involve  a  single  control 
variable  «(^.  The  systems  we  examine  are  time-invariant,  and  the  control  is  to  be  a  fimction 
of  the  states.  Time-optimal  control  will  be  a  piecewise  constant  function  of  time  over  the  sets 
or  regions  of  the  state  space.  These  sets  are  separated  by  curves  in  two-dimensional  space, 
and  by  surfaces  in  three-dimensional  space.  The  separating  sets  are  called  switching  curves, 
dnA  switching  surfaces.  [Ref  1] 

The  procedure  that  will  be  used  in  finding  the  optimal  control  for  both  second  and  third 
order  regulator  problems  can  be  outlined  as  follows  ; 

•  Define  the  problem  precisely 

•  Form  the  Hamiltonian  function 

•  Find  the  H-minimal  control 

•  Find  the  equations  of  the  costate  variables 

•  Determine  the  control  sequences  that  are  candidates  for  the  optimal  control 

•  Determine  the  switching  curves  and  switching  surfaces  that  divide  the  state  space  into 
various  regions 

•  Find  the  control  sequences  that  satisfy  the  boundary  conditions 

•  Simulate  the  linear  time-optimal  regulator  with  initial  conditions  emanating  from  each 
possible  region  of  the  state  space. 
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1.  ProUem  Ddiiiition 


We  consider  the  system  described  by  the  secmid-order  differential  equaticm 


df*  it 


(3.1) 


where  jf(<)  is  the  output,  ■(<)  is  the  control  which  is  restricted  in  nu^tude  by  the  relation 

l-WI  ^  1  (3.2) 

and  a  ,  p  are  real,  distinct,  nonzero  eigenvalues.  The  transfer  function  of  the  system  is 


- \ - 

I7(«) 


(3.3) 


with  real  poles  at  s  ■  and  s  ■  -p  .  U^g  Eqn.  (3.3)  the  state  space  equations  can  be  written 

in  matrix  form  as 


m 


-«p  -(«+p), 


/(0  + 


«(<) 


(3.4) 


Note  that  Eqn.  (3.4)  is  of  the  form 

jKO  - 

First  we  need  to  check  the  controllability  and  the  observability  of  the  system. 


(3.5) 


0  1 
1  -(«+P) 


1  • 
•  1 


(3.6) 
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Since  there  is  only  one  control  input  and  both  matrices  are  nonrii^Mv,  the  syston  is 
controllable  and  observable.  Since  the  eigenvalues  ofil ,  >«  and  -p  are  nm^shive  real 
numbers,  an  optimal  control  edsts,  and  h  is  unique. 

Now,  we  define  a  matrix  P  whose  columns  are  the  eigenvectors  of  A ,  and  a  new  dqsendent 
variable  a(0  by 

a(4  -  (3.7) 

Then,  substituting  for  jr(i)  in  Eqn.  (3.5),  we  obtain 

40  -  (3  8) 


where P  andP"*  matrices  are 


P  « 


1  1 

-  — 1 — 

-p  -1 

-p 

(«-p) 

a  1 

(3.9) 


Eqn.  (3.8)  can  be  written  in  matrix  form  as 


m 


(3.10) 
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or  in  scalar  equations 


For  simplicity,  we  define  the  state  variables«,C0  anda^C^  by  the  rdations 


(3.11) 


(3.12) 


Then,  X}(0  and  satisfy  the  differential  equations 


or  in  matrix  form 


-«  t  -« 

.•  -pP  1-pJ 


(3.14) 


Note  that  Eqn.(3. 14)  is  of  the  form 


jt(0  -  i4x(l)+3«(0 


(3.15) 


Figure  (3.1)  illustrates  in  block  diagram  form,  the  linear  transformation  necessary  to  obtain 
*,(l)  and  fi-om  and  [Ref  1] 
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Figure  3.1  Block  diagniin  of  the  linear  transformation  betrveen  z  and  y  variables 

We  have  thus  transferred  the  original  system  (3.5)  into  an  equivalent  uncoupled 
system  (3.15)  using  similarity  transformations.  Note  that  existence  and  uniqueness  of  time- 
optimal  control  holds  also  for  the  system  (3.15). 

2.  Hamiltonian,  H-Minimal  Control,  and  tke  Equations  of  the  Costate 
Variables 

Let  us  write  the  Hamiltonian  for  this  particular  problem.  We  have 

H~  l’aXj(0Pj(0-P«j(0F3(0+«(0[-«Fi(0-pFa(0]  (3  16) 

Since  the  Hamiltonian  H  is  linear  in  the  control  vector  a(t)  ,  minimization  of  the  Hamiltonian 
with  respect  to  a(0  requires  that  [Ref  3] 

a(l)  -  s^niaPiCO-^PPsCO)  (3  17) 
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where  the  costate  viriabies^,IO  and#^|i|  satis^  the  diflfaeatial  equations 


so  that 


r,m  -  ••>,(») 

p»(0  - 


(3.18) 


(3.19) 


Substituting  Eqn.  (3.19)  into  Eqn.  (3.17),  we  find  that 


(3.20) 


where  the  function  tm  -  has  at  most  one  zero.  Therefore,  we 

conclude  that  the  four  control  sequences 


(3.21) 


are  the  only  candidates  for  the  time-optimal  control  of  this  system. 


3.  Equation  of  the  Switching  Curve 


Since,  the  control  must  be  piecewise  constant,  we  solve  Eqns.(3. 13)  using 


•  A  ■  ±1 


(3.22) 
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to  (A>tan  the  aohitkm 

(3.23) 

-  ({.♦A)e-»*-A 

w^e  Cl  ■  xfilt) ,  I  «  M.  Siminatiiig  the  time  t  in  Eqs.  (3.23)  and  aettiqg 

♦  ■  -J-  (•<«<p)  (3.24) 

we  find  that 

Equation  (3.2S)  desaibes  a  trajectory  in  the  XyX^plane.  The  tr^ectory  originates  at  the  state 
(  C 1*  C))  and  evolves  as  a  result  of  the  action  of  the  constant  control  ■(()  -  A  .  Since  the 
eigenvalues  are  negative,  then  the  tnyectories  generated  by  ■(<)  -  -1 ,  which  we  call  -1 
forced  trajectories,  tend  to  the  state  (1,  1)  of  the  state  plane.  The  trajectories  generated  by 
«(0  •  +1  which  we  call  + 1  forced  trajectories,  tend  to  the  state  (-1,  -1)  of  the  state  plane 
[Ref  1],  Since, 

(C,  +  A)‘*'-A  -  ±1  1-1,2  (3  26) 

where  are  the  eigenvalues  and  A  -  i:l .  The  ~I  forced  trajectories  are  shown  in 
Fig.(3.2)  and  the  +I  forced  trajectories  are  shown  in  Fig.(3.3).  Since  the  origin  of  the 
state  space  is  the  desired  terminal  state  and  since  we  must  reach  the  origin  using  either 
control «  -  +1  or  the  control  u  -  -1 ,  we  isolate  the  two  forced  trajectories  which  pass 
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throu^them^jn.  Wedenotediesetn9>ctoriestoAeor^byY«  andy.  •  Mofepreciacly,T« 
is  given  by 

They,  curve  is  given  by 


Figure  3.2  -1  Forced  Trajectories 
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Using  the  shape  of  tiw  forced  trtyectories  shown  in  Figs.  (3.2)  and  (3.3),  we  can 
conclude  that  only  the  control  sequence  { -•-1 }  can  force  any  state  on  the  y*  curve  to  the 
origin.  Similarly,  only  the  control  sequence  { *1  }  can  force  any  state  on  the  y.  curve  to  the 
origin.  Thus,  we  have  derived  the  control  law. 

If  (*i»J^)ey^  then  «•(/)-  +1  (3.29) 

If(Xj,a^)6y.  thenx*(0  ■  -1  (3.30) 

We  call  the  union  of  the  y^  and  the  y.  curves  switching  curve  [Ref  1].  Then 
combining  Eqns.  (3  .27)  and  (3  .28),  the  y  curve  is  given  by 

X,  (3.31) 

Y  -  :  X,  -  _L>I(l+|x,|)*-ll  ) 

ixj 
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Switching  curves  in  Xj  x^  plane  for  uncouptod  system  (3. IS),  and  in  plane  for  the 
system  (3.5)  are  shown  in  Figs.  (3.4)  ami  (3.5). 


Figure  3.5  Switching  Curve  for  the  system  (3.5) 


Let  us  denote  the  set  of  states  to  the  rigitt  oftfie  y  curve  as  and  die  set  erf* 


points  to  the  left  of  the  Y  curve  as  Jl..  Clearly, 


R, 


(3.32) 


Using  Eqns.(3.32),  we  can  conclude  that  the  control  sequence  {  +1,  -1  }  can  force  any 
state  belonging  to  set  Jt^  to  the  origin,  and  control  sequoice  {  -1,  +1 }  can  force  any  state 
belonging  to  set  R_  to  the  origin.  Then,  tiine>optunal  control,  as  a  function  of  the  state 
is  given  by 


«•  -  -  +1  V  e  Y*  u  ir* 

«•  -  a*(Xj.a^)  -  -I  V  e  y,  u  M, 


or  in  other  words,  the  optimal  control  in  terms  of  the  state  variables 

«•(*!»*,)  -  +  (3.34) 

1*1 1 

An  alternative  solution  to  the  optimal  control  in  terms  of  states  can  be  found  in  Ref  4.  We 
can  easily  obtain  equations  for  switching  curve  and  time-optimal  control  in  terms  of  and 
^2  We  find  that,  *j(r)  and  are  related  to  and  /,(<)  by 


*iW  - 


The  equations  of  the  switching  curve  of  time-optimal  control  are  given  by 

-aPv,(<)-av.M 


(3.36) 
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and 


r«P/iW-V*(OI 

Equation  (3.36)  and  (3.37)  demonstrate  the  advantage  of  using  X|(<)  and  as  state 
variables. 

4.  Analytic  Solution  for  the  Minimum  Time  t* 

We  may  now  evaluate  the  minimum  time  t*  required  to  force  any  initial  state 
to  the  origin  (0,  0)  using  the  time-optimal  control  law  given  by  Eqns.(3.33).  Let  us 
consider  an  initial  state  X  -  (x,,j^),  as  shown  in  Fig.  3.6,  and  the  time-optimal  trajectory 
XWO  to  the  origin,  where  W  ■  (WitW,)  is  on  the  y  curve  [Ref  1]. 


Figure  3.6  Time-optimal  traj^tory 
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Let  us  assume  ■  -  A  *  -  is  the  optimal  control  applied  during  the  tnyectory  WO,  ^  is 
the  time  required  to  go  from  IF  to  O,  and  is  the  time  required  to  go  from  A"  to  IF.  Then, 
using  Eqns.(3.23)  we  have 


0  -  (irj  +  A>'*^-A* 

Solving  for  I,  in  the  above  equations,  we  find  that 


<1  - 


and  from  equation  (3.38)  we  have 


-A 


•  +  (ir,+A 


where  ^  = 


i 

a 


(3.38) 


(3.39) 


(3.40) 


Using  the  shape  of  Fig.  3.6  and  Eqns.  (3.29)  and  (3.30),  we  conclude  that. 


A*  - 

We  again  use  Eqns.  (3.23)  to  obtain  r,.  Then,  we  have 

-  (x,-A>  "^  +  A’ 

-  (x,-A>‘'*^  +  A’ 


(3.41) 


(3.42) 
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Note  that  we  use  a  ■  -*A* .  Since,  during  the  tnyectoryXIF  we  have  a  ■  -A*.S<dvh^for 
in  the  above  equation  we  d>tain 


•  .  V.-*-] 


and  from  Eqn.(3.43),  we  have 


1*1-*  ^ 


Since,  t*  •  f,,  then  t*  is  given  by 


.  \  w,.A-  a,-A-J 


(3.43) 


(3.44) 


(3.45) 


We  want  to  find  /  *  as  a  function  of  *j  and  only,  so  we  must  eliminate  w,  from  Eqn. 
(3.45).  Combining  Eqns.(3.40)  and  (3.44),  we  find  that 


0  =  -A’  + 


2A*  +  (J^-Ai 


A* 


(3.46) 


which  provides  us  a  relationship  between  Wj  *j ,  and  a^.For  specific  values  of  a  and  p 
Eqn.(3.46)  reduces  to  a  quadratic  expression.  For  example  for  a  ■  1  and  p  -  2  ,  we  have 


w. 


4Xj  -  2*,-2A  •  xl±  ^(8A  ‘x,  -  16A  'x,  +»r,*  )( 1  -  A  ’Xj  )* 


(3.47) 
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Choosing  the  appropriate  sign  for  Wj  and  substituting  into  Eqn.(3.4S),  we  can 
obtain  an  analytic  expression  in  toms  of  the  state  JIT  -  Since  we  know  the  sign  of  A* 

from  Eqns.(3.33),  we  can  easily  obtain  the  switching  time  and  the  minimum  time  t  *,  required 
to  drive  any  initial  state  to  the  origin. 

S.  Simulation  of  the  Linear  Time-Optimal  Regulator 

Using  a  computer  simulation,  we  test  the  accuracy  of  the  solutions  by  choosing 
the  initial  conditions  in  the  regions  defined  by  £qns.(3.32)  with  a  ■  1  and  p  >  2 .  Figure 
3.7  shows  the  state  trajectories  for  the  system  (3.15)  emanating  from  the  region  R^.  Time- 
optimal  control  as  a  function  of  time  is  shown  in  Fig.  3.8.  As  we  claimed  before,  the  control 
sequence  { +1,-1}  drives  the  states  to  the  origin  with  at  most  ^-1  switching  in  time-optimal 
control.  State  trajectories  in  plane  are  shown  in  Fig.  3  .9.  Next,  we  simulate  the  system 
(3.15)  with  initial  conditions  emanating  from  the  region  R_ .  State  trajectories  and  the  time- 
optimal  control  are  shown  in  Fig.  3.10andFig.  3.11.  This  time,  the  control  sequence  {-1,+1} 
drives  the  states  to  the  origin  with  at  most  n-J  change,  in  the  control  function  as  we  suggested 
before.  State  trajectories  in>’y^^  plane  are  shown  in  Fig.  3.12. 

The  desired  terminal  state  was  the  origin  of  the  state  space.  Upon  reaching  the 
origin  the  control  effort  must  be  shut  off  in  order  to  maintain  the  system  at  rest.  In  both 
simulations  switching  time  and  minimum  time  t  *  agree  with  the  calculated  values  obtained 
from  Eqns.(3.39),  (3.43),  (3.45),  and,  (3.47). 
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Figure  3.8  Time-optimal  control 
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Figure  3.9  State  trajectories  in  yijfi  plane 


Figure  3.10  State  trajectories  in  XjXj  plane 
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Figure  3.11  Time-optiinal  control 


Figure  3.12  State  trajectories  in  plane 
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IV.  TIME-OPTIMAL  CONTROL  OF  A  THIRD-ORDER 


PLANT  WITH  THREE  REAL  EIGENVALUES 


A.  GENERAL 

In  the  previous  chapter  we  solved  the  time-optimal  control  problem  for  a  second-order 
plant.  We  showed  that  the  time-optimal  control  can  be  determined  as  a  function  of  the  state 
by  means  of  a  switching  curve  which  divides  the  state  plane  into  two  regions.  In  this  chapter 
we  consider  the  time-optimal  control  problem  for  a  third-order  plant  with  three  distinct  real 
and  negative  eigenvalues. 

1.  Problem  Definition 

We  examine  the  system  described  by  the  third-order  differential  equation 


^^+(o  +  p  +  y)^^+(«P  +«y  +yP)^^+(«Py)/(0  •  *(0 

**  *  (4.1) 


where  o  ,  p ,  and  y  are  real,  distinct,  nonzero  eigenvalues.  The  transfer  function  of  the 

system  is  „  ^ 

IW  .  G{$)  -  - - - 

(»+«K»  +  PX»+Y)  (4  2) 


Using  Eqn.(4.2)  the  state  space  equations  can  be  written  in  matrix  form  as 


0 

1 

• 

0 

jKO  - 

0 

0 

1 

+ 

• 

,-«Py 

-(op  +  aY 

-(o+P+y), 

1 

(4.3) 
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Again,  as  a  first  step  we  need  to  chedc  the  ccHitrdlability  and  the  observatMlity 
of  the  system  (4.3).  Since  Q  and  R  matrices,  ^ven  by  Eqns.(2.17)  and  (2.18)  are  both 
ncmsingular,  the  system  is  controllable  and  observable.  The  eigenvalues  are  all  noiqx>sitive  and 
real,  so  an  optimal  control  exists. 

Using  partial  fiaction  eq}ansion,  we  decouple  the  system  (4.3)  with  P  and  P  given 


by 


1 

1 

1 

« 

(«-PXy-P) 

P 

(«-yXP-y) 

Y 

(«-PXP-Y> 

_ P! _ 

(«-yKy-P) 

Y* 

(fi-«KY-«)  («-PMy-P) 

(«-yXP-y)J 

- 

•  P  P+Y  1 

«Y  Y**  1 
c  P  p  + «  1 

As  before  we  use  Eqns.(3.7)  and  (3.8)  to  obtain 


-«  • 

i 

m  - 

•  -p 

0 

1 

§  t 

-Y, 

1 

«W 


where  z(t)  satisfies  the  differential  equations 


-  -«<,(<) +«(0 

4iW  ■ 

tjiii  -  -y«,(<)+«(<) 


(4.4) 


(4.5) 


(4.6) 


(4.7) 
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For  simpUcity.  we  define  the  uncoupled  suite  variab^  ^ 


*jW  “  •*tW 

(4.8) 

J^W  -  YI^W 


where  «,(<).  and  satisfy  the  differential  equations 

J^(t)  - 

■  -Y*»W+Y«(^ 


(4.9) 


or  in  matrix  form 


-a  •  t 

a 

■ 

f 

•  -p  • 

P 

,•  •  -Y 

Y. 

m(A 


(4.10) 


2.  Hamiltonian,  H-Minimal  Control,  and  the  Equations  of  the  Costate 
Variables 

The  Hamiltonian  is 


H  •  1-  ap^^0x^^H  -  -  YP,(<)ab(0  **Wi.  «^i(0  +  P^,(<)  ♦  Y/sWl  (411) 


The  control  n(0  which  minimizes  the  Hamiltonian  is 


«(t)  -  -*lgm{xp^iH*^p^{(i*yp^{ti)  (4.12) 
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where  the  coststevaridrfetfylO.J  •  lAI  satiify  the  equetioiis 


dB 

a»i«i 

ay 

ay 

a^M 


Y#bC0 


(4.13) 


so  that 


(4.14) 


Substituting  Eqn.(4. 14)  into  Eqn.(4. 12),  we  find  that 


«(0  - 

Then,  the  candidates  for  time-optimal  control  are  the  sox  control  sequences 


(4.15) 


(4.16) 


3.  Equations  of  the  Switching  Curve  and  the  Switching  Surface 

Again,  we  solve  Eqns.(4.9)  using 

n(<)  -  A  -  ±l 

to  obtain  the  solutions 

*i(0  -  (5,-A)a  -*+A 
*iW  -  (?,-A)a->'*A 

-  (5,-A)a-T«+A 


(4.17) 


(4.18) 
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Eliimintii%timei  inE(pis.(4.18),  wefodliuit 

1 

•♦A 

^  (4.19) 

■♦A 

Eqn.(4. 19)  describes  a  tn^ory  in  the  three><ltinenrionaI  state  space.  From  Eqn.(4. 18)  we 
conclude  that 

UlU  -  A  ,  I  -  1A3  (4.20) 

where  A  -  Al.  This  means  that  a  trajectory  ^lerated  by  x  •  +1  tends  to  the  point  (1,1,1) 
and  a  tnyectory  generated  by  x  -  -1  tends  to  the  point  (-1,-1,-!). 

Now,  let  { Vi }  denme  the  set  of  states  which  can  be  forced  to  the  origin  (0,0,0) 
of  the  state  space  by  application  of  the  control  x  ■  A*«±l .  We  use  to  indicate  a  state 
belonging  to  the  set  {Vi}  and  x,^,  x^,,  x^  to  indicate  the  components  of  x,  .  If  denotes 
the  positive  time  required  to  forcex^  to  the  origin  using  x  •  A  *  -  A1 ,  then  from  Eqn.(4. 1 8) 
we  have 


•  -  (x„ -A A* 

•  -  (x„-A>-'‘^*A- 

•  -  (x,^-A  V^+A* 


or  equivalently 


*14  " 
*»4  - 


A*- A*x*^ 
A*- A*e^^ 
A*“  A*x^^ 


(4.21) 


(4.22) 
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Let  {  V| }  denote  the  set  of  states  which  can  be  forced  to  the  set  {  V, }  by 
application  of  the  control  m  •  -A*.  Again,  let  vector  indicate  the  states  bdonging  to  set 
{ V,}  and  the  components  ofj^  be  and  If  denotes  the  positive  time  required 

to  force  X,  to  a  state  x^  { Vj },  then  usir^  Eqn.(4. 18)  we  obtain  the  states  belonging  to 
{V,}, 

x^,  -  (k^,+A>  *'-A* 

(4  23) 

or  equivalently 

*U  "  -A*  +  (x^,+A>“‘‘ 

Xm  -  -A*+(x^,+A>'“^  (4  24) 

JSa  -  -A*+(x^+A 


Thus,  we  have  defined  the  sets  {  Vj }  and  {  Vj  }.  Eqns.  (4.22)  and  (4.24)  imply  that  the 
trajectory  originating  at  any  point  Xj  {  V, }  and  generated  by  x  ■  -A  *  will  remain  on  the 
surface  {  Vj }  until  it  hits  a  point  on  the  set  (curve)  { Vj }. 

To  simplify  the  Eqns.  (4.22)  and  (4.24),  we  define  new  variables  and  ^  by 

^  (4.25) 

Using  these  new  variables,  Eqns.  (4.22)  and  (4.24)  become 


*U  •  A--A V 
x„  -  A--A V 
x,^  -  A--A V 


(4.26) 
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(4.27) 


*w  ■  -^**ip^*^i*i* 
^  •  -A*^t«^*A*)«,» 

Substituting  Eqns.  (4.26)  in  Eqns.  (4.27)  we  dilain 


A-*m  •  («,*,)• 

a-*m  - 

A*J^4  - 


(4.28) 


For  simplidty,  we  define  new  variables  Wj,  and  by 

-  *1 
•  ^*1 


(4.29) 


Since  we  specified  the  times  t^  and  positive,  this  implies  that 


l<x, 


I  -  1,2 


(4.30) 


where  is  given  by  Eqn.(4.25).  Condnning  Eqns.  (4.29)  and  (4.30),  we  obtain  the  inequality 


1  <  Wj  <  Wj 


Using  the  variables  ,  and  w,  ,  Eqns.  (4.26)  and  (4.28)  become 


(4.31) 


A’x^,  -  l+2w,--ir,- 
ATx^  -  l+2ir,^-irj^ 
A*J^  -  l+2ir/-irj^ 


(4.32) 


A’jCj  j  -  -1 +2ir,*-ir,“ 

A’*,.!  " 

A-*,,i  -  -t*2w,y-w,y 


(4.33) 


Now,  let  us  state  some  important  properties  of  the  sets  {  V, }  and  {  Vj  }. 


•  The  sets  { V|  }  and  {  Vj  }  are  symmdric  about  the  origin. 


•  In  the  three-dimenacmal  state  space,  the  set  { Vj }  is  a  curve  and  { Vi }  is  a  suiftce. 

{ V, }  divides  the  state  space  into  two  parts. 

•  The  sets  {  V| }  and  {  V,  }  are  formed  by  fiunilies  of  smooth  and  coirtimious 
tnyectories. 

•  The  sets  { Vj}  and  {  V] }  are  infinite  in  extent.  The  origin  is  contained  in  the  set  {V,}. 
the  set  {  V]  }  is  contained  in  { V|  }. 

•  The  state  (1,1,1)  is  above  the  sur&ce  {  Vj},  and  the  state  (-1,-1,-!)  is  below  the  sur&ce 
{V.}. 


In  order  to  determine  the  optimal  control  law,  we  need  to  find  wdiether  the  state 


*  given  by 


is  above,  on,  or  below  the  surface  { V,  }.  We  set 


(4.34) 


*1.1  -  *1*  *1.1  •  *1 


(4.35) 


in  the  first  two  Eqns.  of  (4.33)  and  solve  these  two  equations  to  determine  the  values  of 
w,,  iVj  and  A  •  -  +1  or  A*  -  -1  .  We  need  to  satisfy  the  inequality  given  by  (4.31). 
Then,  we  substitute  the  values  of  Wj ,  iVj,  and  A  *  in  the  last  equation  of  (4.33)  and  evaluate 
We  can  compare  the  computed  value  ofj^  j  with  the  last  component  of  the  state  x. 
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If 


*i“*M^*  (4.36) 

then  we  say  that  x  is  above  the  surftce  { Vj }.  If 

then  X  ^  {  Vj },  and  if 

(4.38) 

then  we  say  that  x  is  below  the  surface  {  Vj  }.  Figure  4.1  shows  an  illustration  of  the 
projection  Xj  ,  of  a  state  x  on  the  surfiu:e  {  }  [Ref  1].  We  draw  a  straight  line  parallel 

to  the  X,  axis  throu^  the  point  x  -  which  intersects  the  sur&ce  { Vj }  at  a  point 

X|  >  (X|,x^»ji^)  .Comparison  of  x^  with  x^  indicates  whether  x  is  above,  on  or  below  the 
surface. 


Figure  4.1  Projection  x  j  of  the  state  x  on  the  surface  {V|} 
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4.  Optimal  Control  u* 


lone-optiinal  control  u  * ,  whidi  forces  any  state  x  to  the  origin  can  be  d^ned 
in  the  following  way 

If  *  is  above  {  Vj  }  then  «  •  -  (-!)■ 

If  *  is  bdow  {  V|  }  then  «  •  »  -(-1)*  (4.39) 

If  *  is  e  {  V,  }  then  «  •  -  (-lyA* 

If  X  is  €  {  Vj  }  then  «  •  -  -(-1)*A* 

Let  us  show  that  the  control  law  given  by  Eqns.  (4.39)  is  the  time-optimal  one.  We  recall  that 
if  the  state  x  bdongs  to  {  V, },  then  the  control  switches  exactly  once.  Since  the  system  has 
three  real  eigenvalues,  the  time-optimal  control  can  switch  at  most  n-J  times.  Let  us  consider 
the  state 


*1 


i 

1 

1 


(4.40) 


which  is  above  { }.  Since  n  =  3,  the  control  law  (4.39)  states  that  x  *  »  - 1  .  Suppose  that 
at  X|,  we  apply  the  control  x  *  -  +1 .  From  Eqn.(4.20),  all  the  trajectories  generated  by 
X  •  ■  +1  tend  to  the  state  Xj.  So,  the  state  will  remain  at  Xj  forever.  Therefore,  to  generate 
a  trajectory  which  hits  the  surface  {  V, },  we  must  apply  x  *  -  -1  at  Xj  .  If  the  control 
switches  from  x  -  -1  to  x  ■  +1  at  { Vj },  the  total  number  of  switchings  is  n-J.  This  does 
not  violate  the  necessary  conditions.  Now,  let  us  consider  the  other  states  x  which  are  above 
{  V,  }  .  If  X  -  +1,  then  x  tends  to  the  state  (1,1,1),  and  eventually  we  must  switch  to 
K  ■  -1  to  reach  { Vi }.  But  this  method  requires  n  switchings  which  violates  the  necessary 


conditions.  Th^efbre,  if  the  state  is  above  { Vj}  the  control  must  be  «  ■  -1 .  By  the  same 
reasoning  if  the  state  is  below  { V| },  the  control  «  -  -^1  forces  jc  to  { Vt).  In  other  case, 
the  total  number  of  switchings  is  exactly  n-I.  [Rrf.  1] 

Now,  we  need  to  ^w  that  if  a  state  « is  on  { Vj}  but  not  in  { Vj},  the  control 
must  be  «  ■  (-1)PA* .  Suppose  that  for  the  point  e  { Vj },  the  value  of  A  *  is  -1 . 
According  to  the  control  law  (4.39),  we  must  use  «  -  +1  at  Xj.  Application  of  a  - 
generates  a  tnyectory  which  follows  the  surface  {  V| }  and  hits  {  V2  }  at  a  point  at  ^^ch  the 
control  must  switch  to  a  -  -1.  This  control  sequence  requires  exactly  one  switching. 
Suppose  that  at  Xj,  we  apply  a  -  -1 .  The  resulting  trajectory  will  not  follow  the  surface 
{ ViJ.  It  will  go  below  {  V,},  because,  it  will  tend  to  the  state  (-I,-!,-!),  which  is  below  {Vj} 
by  definition.  The  control  must  switch  from  a  -  -I  to  a  ■  +1  so  that  the  state  is  brought 
back  to  {  Vi }.  But  this  control  sequence  requires  exactly  n  switchings.  So  it  can  not  be  a 
time-optimal  one.  From  the  above  considerations,  we  conclude  that  the  control  which  requires 
the  minimum  number  of  switchings  is  the  time-optimal  one.  [Ref  1] 

5.  Simulation  of  Minimum  Time  Control  of  the  Third  Order  Regulator 

We  simulate  system  (4.10),  with  initial  conditions  above,  below,  and  on  the 
switching  surface,  using  a  «  1 ,  p  >  2 ,  and  y  ■  3  .  Figure  4.2  shows  the  three-dimensional 
state  trajectories  emanating  from  an  initial  point  above  the  switching  surface.  Time-optimal 
control  is  shown  in  Fig.  4.3.  The  control  sequence  { -1,  +1,  -1 }  drives  the  states  to  the  origin 
with  exactly  two  switchings  as  we  suggested  before.  State  trajectories  as  a  function  of  time 
are  shown  in  Fig.  4.4. 
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Next,  we  sifmilate  the  syston  starting  frcmi  an  initial  condition  bdow  the 
switching  surface.  This  time  control  sequoice  {  +1,  -1,  +1 }  drives  the  states  to  the  origin, 
again  exactly  two  switchii^.  Three-rhmenaonal  state  tngectories  are  shown  in  Fig.  4.5. 
Time-optimal  control  and  the  state  tnyectori^  as  a  function  of  time  are  shown  in  Figs.  4.6 
and  4.7. 

Lastly,  we  simulate  the  system  starting  from  a  point  on  the  switching  surface. 
Figure  4.8  shows  the  three-dimensional  state  trajectories.  Time-optimal  control  and  the  state 
tr^ectories  as  a  function  of  time  are  shown  in  Figs.  4.9  and  4. 10.  From  Fig.  4.9  the  control 
law  { -1,  +1}  drives  the  states  to  the  origin  with  only  one  switching  . 

All  three  simulations  confirm  that  the  control  law  given  by  (4.39)  is  the  time- 
optimal  control.  Again,  upon  reaching  the  origin  the  control  effort  must  be  shut  off  to  keep 
the  system  at  rest. 
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Fifw«4.1  Three-diBMasioaal  itate  tn^ectorict  irfqntHi  (4.10) 


Figure  43  Hme-optimal  control 
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Figare4.4  Stetetn^jcctorief uaftuctiMoftiBC 


F%are  4^  Three-dimcnfionai  state  trajectories  of  syst«n  (4.10) 
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Figure  4.8  Three^incafioaal  state  tn^ectorics  of  system  (4.10) 


0  03  1  IS 

TeiE  (MOOndB) 

Figure  4.9  Time-optimal  cootrol 
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Figure  4.10  State  trajectories  as  a  fiinction  of  time 
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V.  CONCLUSICK*^ 


We  have  examined  the  time-optiinal  ccmtrol  problem  fbr  one  second-oixler  and  one 
third-order  ^stem.  These  systems  had  the  fi)0owmg  properties  in  common; 

•  The  systems  were  hnear,  and  tune  invariant. 

•  The  transfa- function  ofthe  system  did  not  contain  any  zeros. 

•  The  eigenvalues  of  the  transfer  fimcdon  were  real,  mmpositive,  and  distinct. 

•  Control  was  effected  by  a  single  control  variable  .  whid)  was  bounded  in 
nu^tude. 

•  The  desired  terminal  state  was  the  ori^v^di  was  an  ecpiilibrium  point  of  the  system. 
Upon  reaching  the  origin  the  control  needed  to  be  diut  off  in  order  to  maintain  the 
system  at  the  origin.  [Ref  1] 


The  method  which  we  used  to  obtain  the  time-qjtimal  control  law  was  almost  the  same 
for  each  of  these  systems.  Essential  steps  in  our  synthesis  of  the  control  were, 

•  We  first  reduced  the  system  difid’ential  equation  to  a  set  of  first  order  equations. 

•  We  then  chose  a  convenient  set  of  state  variables  by  means  of  a  series  of  linear 
transformations  which  reduced  the  system  matrix  to  its  Jordan  canonical  form. 

•  We  examined  the  Hamiltonian,  and  found  the  control  which  absolutely  minimized  the 
Hamikonian.  We  observed  that  the  time-optimal  control  had  to  be  piecewise  constant 
and  could  switch  at  most  n~l  times  for  an  nth  order  system. 

•  We  then  determined  the  control  sequences  which  were  candidates  for  time-optimal 
control. 

•  We  used  a  method  of  elimination  to  detemune  the  time-optimal  control.  We  found  a 
unique  control  sequence  fi’om  among  the  candidates  which  would  force  a  given  state 
to  the  origin.  Then  we  developed  the  control  law.  [Ref  1] 
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The  conqriexity  ofdte  oontroller  may  inareaae  rapidly  with  the  inoease  in  the  onter  of 
the  system.  For  ^sterns  whose  order  is  higher  than  three,  some  itovtive  procedure  nnist  be 
used  to  solve  the  astern  of  transcendental  equations  that  describe  the  switdung  hypoaurface . 
Even  thou^  the  equation  of  the  switch  hyperairfiu:e  is  complex,  from  a  concq)tual  point  of 
view  the  operation  of  a  hig}H>rder  time-optimal  system  presents  no  particular  difiBculty.  Quite 
often,  knowledge  of  the  optimal  solution  can  hdp  the  designer  to  construct  an  excellent 
suboptimal  system.  [Ref  1] 

Negative  time  approach  was  used  in  Ref  5  to  determine  the  time-optimal  control  for 
a  third-order  system  with  two  integrators  and  a  single  time  constant.  The  method  requires 
analytic  calculations  of  boundary  conditions  for  each  different  set  of  eigenvalues.  The  process 
of  elimination  among  the  candidates  for  time-optimal  control  reduces  the  complexity  and 
applicable  to  the  higher-order  systems  as  demonstrated  in  previous  chapter. 
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APPENDIX 


PROGRAM  CODE 

1.  OPTIMALX.M 

%  This  program  simulates  the  2nd  order  bang-bang  controllo'  using  a  switching  law  for 

%  the  control  effort 

clear,clc,clg 

%  Setting  eigenvalues  of  the  system 
alfa=l;  beta=2; 

%  Ratio  of  the  Eigenvalues 
k=(-beta)/(-alfa); 

%  State  Equations  for  the  uncoupled  system  (x  variables) 

XA=[-alfa  0;0  -beta];  XB*[-alfe  -beta]'; 

%  State  Equations  for  the  uncoupled  system  (z  variables) 

ZA=[-alfa  0;0  -beta];  ZB=[(-l/(alfe-beta))  (l/(alfa-beta))]’; 

%  State  Equations  for  the  coupled  system  (y  variables) 

YA=[0  l;-alfa*beta  -alfa-beta];  YB=[0  1]'; 

%  Transition  matrix  between  y  (coupled)  and  z  (uncoupled)  systems 
P=[l  l;-alfa -beta]; 

%  Simulation  time 
tf=2.232; 

%  Time  increment  and  number  of  steps  for  simulation 
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dt-0.001;  kmax’Hfi'dt+l; 

%  Equation  of  the  sv^hing  curve  for  uncoupled  systeni(x  variafaies) 
xl=-l. 5:0.01:1.5; 

x2=(xl./abs(xl)).*((l+abs(xl)).'ic-l); 

%  Equation  of  the  switching  curve  fix'  uncoupled  systeni(z  variables) 
c=alfe*(alfa-beta); 

zl=xl;  z2=((c.*zl)./(-bcta*(alfii-beta)*(abs(c.*zl))).*((l+abs(c.*zl)).'Hc-l)); 

%  Equation  of  the  switching  curve  for  coupled  system(y  variables) 

y  1  =(  I  /(alfa*(beta^2-alfii*beta))).  *(alfa.  *x2-beta.  *x  1 );  y2=(  l/(alfa-beta)).  *(x2-x  1 ); 

x=zeros(2,lanax);  z=zeros(2,kmax); 

y=zeros(2,kmax);  u=zeros(l,kmax); 

time=zeros(  1  ,lanax); 

%  Initial  conditions 

x(;,lH3  2]'; 

z(: ,  1  )=[  1  /(alfa*(alfa-beta))*x(  1,1)-  l/(beta*(alfa-beta))*x(2, 1 )]'; 

y(:,l)=P*z(:,l); 

%  Discretize  the  Systems 

[phi,del]=c2d(XA,XB,dt);  [phiz,delz]=c2d(ZA,ZB,dt);  [phiy,dely]=c2d(YA,YB,dt); 
%  Begin  Simulation 
for  i=  l;kmax-l 

u(i)=sign(x(  1  ,i)/abs(x(  1  ,i))*((  1  +abs(x(  1  ,i))y'k- 1  )-x(2,i)); 
x( :  ,i+ 1  )=phi  *x( :  ,i)+del  *u(i); 
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z(:,i+l)-pliiz*z(:,i>+ddz*uCi); 

y(;,H-l)-phiy*y(:j>+ikly*u(>); 

tiinc(i+ 1  )=niine(i)+dt; 
end 

figure(l);  plot(xl,x2.V);  xlabel(’Xl');ylabdCX2'); 

title(’SWITCHING  CURVE  FOR  UNCOUPLED  SYSTEM  (X  VARIABLES)*); 
fi8^irc(2);plot(yl,y2>');xlabel(*Yl');ylabeiCY2*); 

title('SWITCHING  CURVE  FOR  COUPLED  SYSTEM  (Y  VARIABLES)'); 

figure(3);  plot(time,u);grid;  x]abel(TIME  (SecoiKis’);ylabeI('MAGNITUDE'); 

title(’CONTROL  EFFORT  vs  TIME'); 

a}ds([0  max(time)+0.05  -1.75  1.75]); 

figure(4);  plot(x(l,;),x(2,:));grid ;  xlabel('Xl');ylabel('X2'); 

title('STATE  TRAJECTORIES  AND  SWITCHING  LINE  (X  VARIABLES)'); 

hold  on;  plot(xl,x2,'r;');  hold  off 

figure(5) 

plot(y(l,:),y(2,:));  grid;  xlabel('Yl');ylabel('Y2'); 

titleCSTATE  TRAJECTORIES  AND  SWITCHING  LINE  FOR  COUPLED  SYSTEM 
(Y  VARIABLES)'); 
hold  on ;  plot(yl,y2,'r:'); 
hold  ojBF 
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2.  RELAY3BT.M 


%  This  program  simulates  the  time  optimal  control  of  a  third  order  system  having  three 
%real  distinct  negative  eigenvalues 

%  Written  by  Serhat  Balkan  1 2  April  1 994 

clc,clear,clg,!  del  *.met, 

%  Set  the  eigenvalues  of  the  system 
alfa=l;  beta"2;  gama=3; 

%  Transition  matrix  between  y  (coupled)  and  z  (uncoupled)  systems 

P=[(  l/((beta-alfa)*(gama-alfa)^'  (l/((alfe-beta)*(gama-beta))) . 

( l/((alfa-gama)*(beta-gama))); 

(alfa/((alfa-beta)*(gama-alfa)))  (beta/((alfa-beta)*(beta-gama))). . . 

(gama/((alfa-gama)  *(gama-beta))); 

(alfa^2/((beta-alfa)*(gama-alfa)))  (beta^2/((alfa-beta)*(gama-beta))). . . . 
(gama^2/((alfa-gama)*(beta-gama)))]; 

%  State  Equations  for  the  uncoupled  system  (x  variables) 

XA=[-alfa  0  0;0-beta0;0  0-gama];  XB=[alfa  beta  gama]'; 

%  State  Equations  for  the  uncoupled  system  (z  variables) 

ZA=[-alfa  0  0;0  -beta  0;0  0  -gama];  ZB=[1  1  1]'; 

%  State  Equations  for  the  coupled  system  (y  variables) 

YA=[0  1  0;0  0  1; 

-alfa*beta*gama  -(alfa*beta+alfa*gama+gama*beta)  -(alfa+beta+gama)]; 

YB=[0  0  1]'; 
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%  Simulation  time 


tf=2.66; 

%  Time  incremott  and  number  of  steps  for  the  simulation 
dt=0.01;  kmax=tfi'dt+l;  time=0; 

%  Discretize  the  systems 

[phix,debc]=c2d(XA,XB,dt);  [phiz,delz]^2d(ZA^,dt);  [phiy,dely]=c2d(YA,YB,dt); 
%  Set  initial  conditions 
x(:,1H2  3  4]'; 

z(:,lH(l/alfa)*x(l.l)  (l^eta)*x(2,l)  (l/gaina)*x(3.1)]'; 
y(.,l)=P*z(M); 

i=0; 

%  Order  of  the  system 
N=3; 

%  From  Eqn.(4.35)  set: 
xl=x(l,I);  x2=x(2,l); 

%  Call  function  to  determine  wl,  w2  and  the  optimal  control 
[  w  1 ,  w2,  deltas]=solve  1  b(x  1  ,x2); 

%  Calculate  the  third  point  on  the  switching  surface 
x3 1  =de!tas*(- 1  +2  *  w  1  ^ama-w2^gama); 

%  Decide  whether  initial  state  above  or  below  the  switching  surface 
m=x(3,l)-x31; 

%  Find  the  optimal  control  which  drives  the  states  to  the  switching 
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%  surfiux  in  min.  time  \«4ien  states  are  above  the  swHdnng  surfime 
while  m  >  0; 

H+1; 

u(iH-l^N); 

x(:,i+l)=phix*x(:,i)+debc*u(i); 
z(:,i+l)=phiz*z(:,i)+delz*u(i); 
y(:,i+l)=phiy*y(:,i)+dely*u(i); 
time(i+ 1  )=time(i)+dt; 
xl=x(l,i+l); 
x2=x(2,i+l); 

[w  1  ,w2,deltas]=solvelb(xl  ,x2); 

x3 1  =deltas*(- 1  +2*wl  ''gama-w2^gama); 
m=x(3,i+l)-x31; 

end; 

%  Find  the  optimal  control  which  drives  the  states  to  the  switching  surface 
%  in  min.  time  when  states  are  below  the  switching  sur&ce 
while  m  <  0; 

H+1; 

u(i)=-(-l^N); 

x( .  ,i+ 1  )=phix*x(;  ,i)+delx*u(i); 
z(;,i+l  )=phiz*z(:,i)+delz*u(i); 
y( :  ,i+ 1  )=phiy  *y( :  ,i)+dely*u(i); 
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tinie(i+l)=time(i)+dt; 

xl=x(l,i+l); 

x2=x(2,i+l); 

[wl,w2,deltas]’^solvelb(xl,x2); 

x3 1  =dehas*(- 1  +2*  wl  ''gaina-w2''gaina); 
in==x(3,i+l)-x3I; 

end; 

%  Find  the  optimal  control  which  drives  the  states  to  the  switching 
%  curvce  in  min.  time  when  states  are  on  the  switching  surface 
ifm— 0 

counter=l; 

else 

counter=i; 

end 

for  l=counter:kmax-l; 
xl=x(l,i); 

x2=x(2,i); 

[w  1 ,  w2,deltas]=solve  1  b(x  1  ,x2); 
if  (deltas*x(l,i)-l-2*wl+w2  =  0)  &.... 

(deltas*x(2,i)- 1  -2* w  1  ^2+w2'^2  =0  &  deltas*x(3  ,i)- 1  -2* w  1  ^gama+w2'^gama  =  0); 
u(i)=-(- 1  '^N)*deltas; 
else 
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md 

x(;,i+l)=phix*x(:,i)+<idx*u(i); 
z( :  ,i+ 1  )®=phiz*z(:  ,i)+delz*u(i); 
y(:,i+l)=phiy*y(:,i)+dely*u(i); 
time(i+ 1  )=time(i)+dt; 
end 

%  Plot  the  outputs 

plot3d(x(  1 ,  ;),x(2,  ;),x(3, 0,-45,45); 

title(’3-D  PLOT  OF  THE  STATE  TRAJECTORIES  FOR  UNCOUPLED  SYSTEM 
(X  VARIABLES)'), 
meta  3  ax;  pause,clg, 

plot(time,x(l ,  0,tinie,x(2, 0,time,x(3, 0);grid, 
title('STATE  TRAJECTORIES  vs  TIME  (X  VARIABLES)'); 
xlabel('TIME  (seconds)');ylabel('MAGNITUDE'); 
meta  3bx,pause,clg  ;axis([0  max(time)+0. 1  -1.75  1.75]); 
plot(time(  1  ;length(u)),u);grid, 
xlabeK'TIME  (seconds)');ylabel('MAGNITUDE'); 
title('OPTIMAL  CONTROL  EFFORT  (u(t))  vs  TIME'), 
meta  3  c 


axis('normar);  pause, 
plot3d(y(l,0,y(2,0,y(3,0,75,-45); 
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title(*3-D  PLOT  OF  THE  STATE  TRAJECTORIES  FOR  COUPLED  SYSTEM 
(Y  VARIABLES)’); 
meta  Say;  pause,dg, 

plot(tiiiie.y(  1 ,  :),tiine,y(2,  :),tiinc,y(3,  :));grid, 
titleCSTATE  TRAJECTORIES  vs  TIME  (Y  VARBLES)’); 
xlabel(TIME  (seconds)');ylabclCMAGNITUDE’); 
meta  3by,pause,clg 
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3.  SOLVE1B.M 


%  Function  solvelb  decides  the  optimal  control  and  the  required  time  to  drive  the  states 
%  to  the  switching  surtiu:e  or  to  the  switching  curve  and  passes  these  values  to  the 
%  main  program  (relaySbt.m). 

%  Written  by  Serhat  Balkan  12  April  1994 

function  [wl,w2,deltas]  =  solve lb(xl,x2) 

delta=l; 

%  al,  a2,  and  delta  are  the  local  variables  corresponding  to  wl,  w2,  and  deltastar 
%respectively. 

[a  1  ,a2,delta]=solve2b(x  1  ,x2,delta); 

%  Check  if  Eqn.(4.3 1)  is  satisfied  or  not 
if  (al>l)&(a2>al) 
wl=al;  w2=a2; 
deltas=delta; 
else 

delta=- 1 ; 

[a  1  ,a2,deita]=solve2b(x  1  ,x2,delta); 
wl=al; 
w2=a2; 
deltas=deJta; 
end 
end 
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4.  SOLVEIRM 


%  Function  Solve2b  calculates  the  required  time  to  drive  the  states  to  the  swhcldfig 
%  surftce  or  to  the  switching  curve  procesang  the  given  states  and  passes  these  values 
%  to  the  function  solvelb 

%  Written  by  Sertiat  Balkan  12  April  1994 

function  [al,a2,delta]  ==  solve2b(xl,x2,ddta); 

%  Use  the  first  two  equations  of  Eqn.(4.33)  to  find  wl,  and  w2  (al  and  a2  corresponds  to 
%  wl  and  w2  respectively) 

a  1  =delta*x  1 + 1 +0 . 5  *  sqrt(2  *(x  I ''2)+4*delta*x  1 -2*delta*x2); 
a2=2*al  -delta*xl  - 1 ; 

%  Eliminating  any  complex  value 
if  imag(al)  ~=  0; 
delta=-delta; 

a  1  =delta*x  1 + 1 +0. 5  *sqrt(2*(x  1  ^2)+4*delta*x  1 -2*delta*x2); 
a2=2*a  1  -delta*x  1  - 1 ; 
end 
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